A Momentum-Guided Frank-Wolfe Algorithm

نویسندگان

چکیده

With the well-documented popularity of Frank Wolfe (FW) algorithms in machine learning tasks, present paper establishes links between FW subproblems and notion momentum emerging accelerated gradient methods (AGMs). On one hand, these reveal why is unlikely to be effective for FW-type on general problems. other it established that accelerates a class signal processing applications. Specifically, proved variant FW, here termed (AFW), converges with faster rate O (\frac1k 2 ) such family problems, despite same (\frac1k) cases. Distinct from existing fast convergent variants, rates rely parameter-free step sizes. Numerical experiments benchmarked tasks corroborate theoretical findings.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Deterministic Nonsmooth Frank Wolfe Algorithm with Coreset Guarantees

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine Learning problems including 1-median, Balanced Development, Sparse PCA, Graph Cuts, and the `1-norm-regularized Support Vector Machine (SVM) among others. This m...

متن کامل

A Distributed Frank-Wolfe Algorithm for Communication-Efficient Sparse Learning

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a network. We address the key challenges of balancing communication costs and optimization errors. To this end, we propose a distributed Frank-Wolfe (dFW) algorithm...

متن کامل

Efficient Image and Video Co-localization with Frank-Wolfe Algorithm

In this paper, we tackle the problem of performing efficient co-localization in images and videos. Co-localization is the problem of simultaneously localizing (with bounding boxes) objects of the same class across a set of distinct images or videos. Building upon recent stateof-the-art methods, we show how we are able to naturally incorporate temporal terms and constraints for video co-localiza...

متن کامل

k-Means Clustering via the Frank-Wolfe Algorithm

We show that k-means clustering is a matrix factorization problem. Seen from this point of view, k-means clustering can be computed using alternating least squares techniques and we show how the constrained optimization steps involved in this procedure can be solved efficiently using the Frank-Wolfe algorithm.

متن کامل

Correcting Covariate Shift with the Frank-Wolfe Algorithm

Covariate shift is a fundamental problem for learning in non-stationary environments where the conditional distribution ppy|xq is the same between training and test data while their marginal distributions ptrpxq and ptepxq are different. Although many covariate shift correction techniques remain effective for real world problems, most do not scale well in practice. In this paper, using inspirat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Signal Processing

سال: 2021

ISSN: ['1053-587X', '1941-0476']

DOI: https://doi.org/10.1109/tsp.2021.3087910